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ABSTRACT 



This Congressional report discusses recent accomplishments 
and continuing issues in the federal role in helping states and localities 
improve K-12 education. The panel that prepared the report consisted of state 
and local educators, researchers, and other citizens committed to education. 
The document focuses on the implementation of major federal legislation in 
elementary and secondary education,, including Title I, other programs in the 
Elementary and Secondary Education Act of 1965, and the Goals 2000: Educate 
America Act. The report takes as its starting point the Department of 
Education's evidence on the academic achievement of American school children, 
in particular children from low- income families. It describes the current 
federal role in supporting the improvement of elementary and secondary 
education and provides conclusions and recommendations organized around six 
central themes: equity and adequacy in resource allocation; high academic 
standards for all children; assessment, accountability, and support for 
improvement; quality of instructional staff; school, family, and community 
partnerships; and research and evaluation. The text looks at the continuing 
need for federal involvement, pausing to examine trends in reading and 
mathematics achievement and why the achievement gap exists. It discusses how 
the federal role was reshaped in 1994, how the 1994 legislation is being 
implemented, and what remains to be done. (RJM) 
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In the 1 994 reouthorizotion of the Elementary and Secondary Education Act, P.L 1 03-382, Congress called 
for the creation of o panel of researchers, policymakers, and other interested parties to advise the U.S. 
Department of Education on the evaluation of programs authorized under that statute. In fact, panels were 
colled for in two sections of the low. For the purposes of organization and clarity these two panels were 
combined into o single body known os the Independent Review Panel. 

While the authorizing statute creating the panel does not require o report, the panel was unanimous in 
wanting to take this opportunity to express its own views on a number of topics expressly related to the 
forthcoming reouthorizotion of ESEA, especially Utle I. 

By design, this report does not contain any original evaluation or research data. That is the province of 
the reports issued by the Department of Education, entitled Promising Results, Continuing Challenges: Jhe 
final Report of the National Assessment of Title I and Federal Education legislation Enacted in 1994: An 
Evaluation of Implementation and Impact. Rather, the panel has chosen both to express its own interpre- 
tation of the data and to raise issues and concerns that, by their very nature, were not included in the eval- 
uation reports. 

One of our important functions is to serve, both to the Department of Education and the Congress, os on 
expert group advising on the qualities of good evaluation, the limitations of what con be done and o col- 
lective conscience of the need for adequate funding of evaluation and research in these important areas 
of education. 

We urge the reader to examine the data contained in the two separate reports issued by the Department 
of Education os o guide to the issues raised herein, os well os for o fuller understanding of what evalua- 
tion data is available and what information will be forthcoming. 

Rnolly, there ore many, many people who mode the work of the IRP possible. Rather than enumerate 
them here, we hove chosen to devote o separate page for those acknowledgments. The panel joins me in 
thanking oil of them for their work and their dedication to this report. 



INDEPENDENT REVIEW PANEL REPORT TO CONGRESS 



Introduction and Summary 

In this final report to Congress, the Independent Review Panel discusses recent accomplishments and continuing issues 
in the federal role in helping states and localities improve K-12 education. The nonpartisan, congressionally man- 
dated panel's members are state and local educators, researchers, and other citizens committed to providing the 
Congress and the nation with the best possible information about the implementation of major federal legislation in 
elementary and secondary education, including Title I, other programs in the Elementary and Secondary Education 
Act of 1965, and the Goals 2000: Educate America Act. Since 1995, we have met 15 times as a group and devoted 
hundreds, if not thousands, of hours to advising the U.S. Department of Education on the design, implementation, 
and sequencing of evaluation studies. 

We write in response to Promising Results, Continuing Challenges: Jhe Final Report of the National Assessment 
of Title I, as mandated in the Improving America's Schools Act [lASA], P.L 103-382, Sec. 1501. As mandated, the 
Assessment is ". . .planned, reviewed, and conducted in consultation with an independent panel of researchers. State 
practitioners, local practitioners, and other appropriate individuals." Our panel also fulfills the charge in Section 
1 4701 of the law, which requires the Secretary of Education to "appoint an independent panel to review the plan for 
[an evaluation addressing all the other programs and provisions under lASA], to advise the Secretary on such eval- 
uation's progress, and to comment, if the panel so wishes, on the final report." This report focuses on Title I. 

Our purpose here is not to report the implementation and results of Title I and other programs under the Improving 
America's Schools Act. That is the role of the Department of Education. Instead, we offer our perspective and guid- 
ance on the Department's report, in accordance with our legislative mandate. 

Our report takes as its starting point the Department's evidence on the academic achievement of American school- 
children, in particular children from low-income families. While some progress has been made in raising their 
achievement, much more needs to be done. We therefore believe this is a proper area for continued national inter- 
est and support. We next discuss the current federal role in supporting the improvement of elementary and secondary 
education. Based on this recent record, we highlight the following conclusions and recommendations, which we 
believe will continue to advance the crucial goals of educational improvement and equity. These are organized into 
six central themes, which are further developed in the remainder of the report. 
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Equity and Adequacy in Resource Allocation 

Title I plays a crucial, but necessarily supplemental, rale in supparting effarts ta imprave achievement amang paar 
children and ta mave all students taward challenging standards. Title I dallars (representing an average af $61 3 per 
student per year) da nat came clase ta closing the resource gap between rich and poor schook. States and localities, 
which pay for more than 90 percent of the cost of elementary and secondary education, must be primarily respon- 
sible for closing the gap, but have failed to do so. However, to improve the effectiveness of Tide I, we recommend 
the following: 

• We strongly endorse targeting of funds on schools with high proportions of poor students. In addition, we 
recommend that the targeted grants authorized by Congress in 1994, but never funded, be appropriated in 
the next funding cycle. 

• We recommend that Title I be fully funded, which would increase the appropriation from approximately 
$8 billion to about $24 billion, according to the Congressional Research Service. Although this goal is 
ambitious, we must remember that the severest problems facing American education ore those surrounding 
the education of the most disadvantaged children in our society. Title I is the largest and most carefully 
targeted intervention available to help states and local school districts address the educational needs of 
disadvantaged children. As a nation, we should therefore commit ourselves to providing the level of Tide I 
resources needed to moke o difference in their schook. 

• Since the inception of Tide I, the participation of private school children has been guided by the principles of 
providing direct benefits to the child and public trusteeship of the dollars. We continue to endorse these 
principles. We urge public school officiok to attend carefully to their responsibility in selecting students for 
participation and in consulting with private school officiok about how private school students will be served 
under Title I. Tide I programs face real costs in arranging for thk service delivery, and we support the 
continued availability of funds under Tide I to defray those costs. 

• Finally, we urge careful monitoring of the allocation of funds and the provkion of services for other special 
populations served by Title I: students with limited English proficiency and those who ore migrant. Native 
American, and neglected or delinquent. 



High Academic Standards for Ail Children 

States ore off to on excellent start developing high standards, but they need more technical ossktonce and other 
resources to build their capacity to formulate, review, and refine their standards. 

• We encourage the participation of external organizations in revievw'ng and validating state standards and 
assessments. We believe the federal government should continue to stay out of the business of rating state 
standards, os k currently required under federal low. 
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• Both the public and the private sectors need to direct more resources to curriculum development and imple- 
mentation, so that os states translate their standards into curriculum frameworks, the frameworks will be suf- 
ficiently detailed and complete to be useful to classroom teachers and other educators. . 



Assessment, Accountability, and Support for Improvement 

Increased attention has been placed at all levels of government on holding schools and districts— and even federal 
agencies — accountable for results. We find this attention to results appropriate and desirable, but we stress that it must 
be based on legitimate and coherent criteria, adequate support for improvement, and appropriate authority, if it is to be 
effective. To strengthen Title I's accountability provisions, we recommend the following: 

• We strongly endorse the low's insistence on holding schools and districts accountable for having the some 
challenging standards for low-income students os they hove for other students. This should include giving 
Title I students access to a rich curriculum in dll subject areas, not just reading and mathematics. 

• We encourage Title I policy to reinforce and strengthen state systems of accountability. Title I should push 
states to hold all schools — not just Title I schools — accountable for improved achievement, either through 
their own accountability system or through the Title I system, whichever sets a higher standard. 

• States should be using tests that ore aligned with state standards and the content of classroom instruction. 

• To maximize public engagement with these issues. Title I should encourage states to engage in a brood public 
dialogue about the criteria and processes involved in assessment and accountability. 

• Research and effective evaluation in education ore seriously underfunded. The budget for federally 
supported research, evaluation, and technical assistance should increase substantially. 

Quality of Instructional Staff 

As in every other aspect of education, the quality of teachers and other staff is proving to be crucial to the effec- 
tiveness of Title I. To meet this important area of need in Title I, we recommend the following: 

• Because high-poverty schools need and deserve the best teachers, states and districts should be required to 
ensure that teachers and instructional aides in high-poverty schools be at least os qualified os those in 
non-TItle I schools. 



• Greater investment in both preservice teacher education and high-quality professional development for 
teachers is vitally needed. 
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• Congress should not allow districts to spend federal funds to hire poroprofessionols to provide instruction, since 
they generally lock adequate training for that role. Congress should begin to phase out districts' use 
of poroprofessionols in Title I instruction altogether during the next reouthorizotion. Meanwhile, districts should 
he encouraged to use poroprofessionols in noninstructionol roles, and they ore to he commended for placing 
language-minority poroprofessionols in classrooms with high concentrations of students with limited proficiency 
in English. 



School^ Family; and Community Partnerships 

The directions set for Title I in 1994 reflected on understanding of the importonce of fostering strong portnerships 
among schools, families, and communities. To huild on this effort, we suggest the following: 

• We recommend that states, districts, and schools moke the necessary investments in staff, programs, and 
evaluations to fully implement Title I's mandates for comprehensive and ongoing school, family, and 
community partnerships to promote student success. We recommend redirecting attention away from the 
confusing and often mechanical term of "school-parent compact" to clarify the importance of estahlishing 
clear policies, planned programs, and useful evaluations of school, family, and community partnerships. 



Research and Evaluation 



We became all too aware of the scarcity of resources for research and evaluation in education as we prepared this 
report. The research, information, and evaluation base was inadequate to responsibly advise Congress on the issues 
addressed in this and the Department of Education's reports: Pertinent studies were too few and marginally funded, 
and the broader research base that could be used was spare. This is in marked contrast to levels of support for such 
research and evaluation in other sectors. 



• Congress should set aside 0.5 percent of Title I funds, half for evaluation and half for research and 
development. This would make $40 million available for such efforts — o reasonable amount — compared 
to the $5 million currently being spent. 

• Evaluation activities should include longitudinal studies of Title I that measure the achievement of 
participating students over time and in ways that determine effects. They should also include studies 
designed to inform practice early in the next reauthorization period. 

• Funding is also needed for research and development efforts that identify effective practices and refine 
model programs for wider implementation. 



We remain generally supportive of the philosophy and provisions of the 1994 reouthorizotion, which aimed to hold 
all children and all schools to the same challenging standards. It would be premature to change the law's key provi- 
sions now, before there has been time for implementation and full evaluation. Many of the outcomes of early imple- 
mentation look positive. But in the future, educators and policymakers must attend to the depth and quality of imple- 
mentation. 
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I. what is the federal role in elementary and 
What is the continuing need for this role? 



second 



I 



ry education? 



Historically, public education in the United States has been a decentralized system, with states possessing the primary 
constitutional responsibility for the provision of elementary and secondary education. 8ut since the nation's earliest 
days, the federal government has also played a critical role, recognizing that an educated citizenry is essential to 
maintaining a democratic government and promoting the common good. 

Indeed, the federal role in public education is not new, but dates back to the 18th century. As early as 1785, the 
Congress of the Confederation encouraged the expansion of public schools into the new western territories by setting 
aside land for their support. Under the Land Ordinance Act of 1785, it divided the Northwest Territory into town- 
ships, with one section in every township set aside for the support of public education, and in the Northwest 
Ordinance of 1787 it declared that schools should "forever be encouraged." 



In 1867, Congress created the Department of Education, later renamed the 8ureau of Educotion, to collect and pub- 
lish educational data, and to work with states and districts to standardize data. It also sought to identify promising 
educational practices and share this information with states and schools. After the Civil War, Congress also required 
that all new states admitted to the Union provide free, nonsectarian, public schools. 

In the 20th century, the federal government offered support for vocational training for high school students. The 
Smith-Hughes Act of 1917 and the George-8arden Act of 1946 focused on the provision of training in agriculture, 
industry, and home economics. 

Federal involvement in K-1 2 education grew substantially in the years after World War II, and the role evolved from 
one of encouraging the general expansion of public education to one of supporting innovation, improvement, and 
equity. Since then, the federal government has invested in elementary and secondary educotion in oreas of press- 
ing national interest, motivated by strategic concerns about national defense, economic prosperity, and social well- 
being. It was a national defense concern — poor nutrition among World War II draftees — that prompted the 
Congress to establish the national school lunch program; After the launch of Sputnik, fears that Russian scientific 
expertise might translate into military dominance led to the passage of the National Defense Education Act, an effort 
to improve American mathematics and science instruction. The Higher Education Act in 1964 and the Elementary- 
Secondary Education Act of 1 965 established the broad outlines of what is in place today. In addition to legislative 
action, the federal role in education also has included an important judicial component. Most notobly, in 1954, the 
Supreme Court's historic decision in Brown v. Board of Education paved the way for desegregation of the nation's 
schools. 

Federal education aid has provided states, districts, and schools with extra resources to improve education. Although 
local and state funds pay for more than 90 percent of the cost of elementary and secondary educotion, federal 
money in the United States — unlike in other nations — is a significant source of discretionary funds that can encour- 
age greater innovation. It can be the oil that makes the gears operate more efficiently and effectively for all stu- 
dents. Similarly, research supported by fedei;dl funds can contribute to innovation in practice and improvement in 
policy. 
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Championing equity is a fundamental dimension of the federal role in the nation's schools. Among the ways the 
. federal government has sought to do so is by targeting assistance to selected groups with special needs, such os poor 
children and children with disabilities. Indeed, the largest federal effort in K-1 2 education is Title I of the Elementary 
and Secondary Education Act (known as Chapter 1 from 1981 to 1994), which provides additional resources to 
schools with large concentrations of students from low-income families to help raise their academic performance. 
This $8 billion program represents more than 40 percent of all federal aid to elementary and secondary education, 
and our report focuses particular attention on it. 



Trends in Reading and Mathematics Achievement 

As we examine Title I and the federal role, it is important to consider them in the broader context of student achieve- 
ment and the social conditions in which children live. Precisely because education is so important in this nation, its 
citizens engage in heated public debates over the condition of education and how well or poorly our students ore 
performing. As a panel, we have carefully reviewed the evidence in an effort to offer a balanced assessment of the 
current state of student achievement and the circumstances of educationally disadvantaged children. We have select- 
ed 1 970 as a starting point for comparison, becouse it coincides with the eorly implementotion of the contemporary 
federal role (the Elementary and Secondary Education Act was passed in 1965) and with the inception of o consis- 
tent source of data on student achievement (the National Assessment of Educational Progress, which measures how 
America's students are performing in the core subjects, began in 1969). We look at overall achievement trends not 
as evidence of the effectiveness of the federal role in K-1 2 educotion — ^which is a minor influence on ochievement 
compared with the more active state and local roles — but to ground our assessment in a clear understanding of the 
strengths and weaknesses of the American education system. 

The overall picture of student achievement today is a somewhat encouraging one: on average, today's schoolchild- 
ren have made gains in mathematics and ore holding steady or may be improving in reading. Student scores on 
the National Assessment of Educational Progress (NAEP) indicate that mathematics achievement has increased 
steadily in grades 4, 8, and 12 since 1970, while reading performance has remained largely stable since the early 
1970s and improved modestly in 1998. While this is encouraging, it is certainly no cause for celebration. 

In the subject of reading, it is not that children ore reading poorly — indeed, in international comparisons of read- 
ing achievement, American students hove fared quite well. The 1998 NAEP reading assessment has also brought 
hopeful news. Nationally, reading achievement improved since 1994, particularly among 8*^ graders and lower 
performing students in 4*'’ and 8*'’ grades. However, the increases in 4*'’ and 12*'’ graders' overage scores repre- 
sented no net gain over the overage scores of their counterparts in 1 992. At the some time, expectations hove 
increased about how well today's children must read to succeed in on increasingly complex and competitive job 
market. Although we ore encouraged by the recent improvements, American students' reading achievement still 
remains inadequate: 38 percent of 4*'’ graders, 26 percent of 8*'’ graders, and 25 percent of 12**’ graders read 
below the "basic" level, os measured by the 1 998 NAEP reading assessment.’ We ore also deeply concerned that 
the gap in reading achievement between students from low-poverty and high-poverty schools widened between 
1988 and 1996.* 
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In mathematics, there have been same heartening develapments. There has been a general upward trend in mqth- 
ematics achievement far all ages (9-, 1 3-, and 17-year-alds), and the gap between paar and nanpaar is alsa dimin- 
ishing. The mathematics achievement af students in the highest-paverty schaals rase cansiderably between 1992 
and I996^s it did far students averall — increasing by II paints. ’ But this is na cause far camplacency. The 
average mathematics achievement af 9-year-alds in high-paverty schaals still falls behind their peers in law-paver- 
ty schaals. Mareaver, American students' perfarmance in mathematics is still nat internatianally campetitive, and 
while they can salve basic prablems well, they have trauble tackling mare advanced material. In camparisaiis with 
ather natians, U.S. 4*^ graders perfarm at dr abave the internatianal average in mathematics. But this advantage 
quickly deteriarates: U.S. middle-schaal students lag behind their peers fram ather cauntries in mathematics.‘ By 
the end af high schaal, U.S. students rank next ta last in advanced mathematics, accarding ta the Third Internatianal 
Mathematics and Science Study (TIMSS). ' 

On a mare encauraging nate, fallawing an the heels af the curricular reforms of the l9B0s, the percentage of stu- 
dents completing challenging coursework has increased, across all income levels. Between I9B2 and 1994, the per- 
centage of high school graduates taking the courses recommended in A Notion ot Risk increased from 14 percent to 
50 percent. (The I9B3 report recommended that students take 4 years of English, 3 of social studies, 3 of science, 
and 3 of mathematics.) Students ore not just taking more courses, but they ore taking more high-level classes. The per- 
centage of all high school graduates who hove token upper-level mathematics courses has increased steadily and con- 
siderably since 1 9B2, with particularly dramatic increases among minority students. For example, the proportion of 
black high school graduates who hove token geometry nearly doubled, jumping from 29 to 5B percent, os did the 
percentage of Native American high school graduates taking geometry, increasing from 33 to 60 percent. ' 

Why the Achievement Gap Exists 

Over the post three decades, much has changed in the broader society in which schools educate children. In partic- 
ular, poverty rotes should be of particular concern to us os educators and policymakers because children under IB 
moke up a significant proportion of the poor — about 40 percent — even though they represent only about a quar- 
ter of the population.’ Thirty years ago, in 1 970, 1 5.1 percent of children lived below the poverty level. That rote 
reflected a substantial decrease in child poverty that took place during the previous decade, down from a 26.9 per- 
cent rote in I960. But during the 1970s, the child poverty rote rose again, reaching 22.3 percent in I9B3. The 
poverty rote for children has remained high in the years since then, fluctuating between 1 9 and 22 percent. In 
1997, the most recent year for which data ore available, the rote was 19.9 percent. Poverty also affects certain 
racial and ethnic populations more than others; Block and Hispanic children ore disproportionately likely to be poor, 
more than twice os likely os ore white children." 



We ore particularly concerned about the relationship between poverty and student achievement, not because we 
think the federal government should assume the major responsibility for educating poor children, but because the 
educational success of poor children should be the business of states, localities, and schools, with federal assistance. 
The achievement gap between poor and nonpoor students and between white and minority students is not inevitable, 
but reflects many kinds of inequity in educational opportunity. " 






Tlie effect of poverty both on student achievement and on access to educational resources has been well document- 
ed and seems to stem from a host of factors. Beginning in the early years, low-income and minority children hove 
disproportionately less access to preschool. In elementary and secondary school, low-income and minority students 
are more likely to attend schools with high concentrations of poverty, a factor that contributes very strongly to lower 
achievement. Low-income students have higher rates of mobility, which also may depress achievement in declining 
schools — both for those who stay and for those who move away. ’’ 

Generally, students in poor districts lack instructional resources. Mathematics and science classes with high concen- 
trations of minority students are more often taught by underqualified teachers; classes in high-poverty schools are 
also more often taught by underqualified teachers.'^ In addition, poor students have less access to technology; Public 
schools with a large proportion of poor children were less likely than others to be connected to the Internet. 

Lack of access to resources and qualified teachers poses additional challenges, given that today's schools are edu- 
cating an increasingly diverse population. Immigration has fueled enrollment growth, especially in states such as 
California, Florida, New York, and Texas, creating new challenges for schools. But non-native-English-speaking stu- 
dents lack adequate access to language-support programs that enable them to keep pace with their English-speak- 
ing peers. According to the most recent data available from the Office for Gvil Rights, 2.6 million students have been 
identified as being in need of programs for limited-English-proficient (LEP) students in 1 994, but only 2.3 million 
students were actually enrolled in LEP programs that year.'‘ School districts are scrambling to hire enough bilingual 
teachers and provide the resources necessary to meet the needs of this new influx of students, while programs serv- 
ing American Indian students must find ways to connect effectively to the cultural backgrounds and needs of their 
students. 

Once in school, different students are taught different things, and are held to different — and for low-income and 
minority students, often lower — standards. '' Although there have been improvements, low-income high school stu- 
dents are less likely to be enrolled in college-preparatory coursework, as are African American and Latino 10*^- 
graders." In contrast, a rigorous mathematics curriculum improves scores for all students.” Grading systems also 
reflect lower expectations; A grade of "A" in a high-poverty school often is equivalent to a "C" in a low-poverty 
school when measured externally on standardized tests.” 

In a society that is demanding higher skills of its citizens, student achievement is still simply not where it should be. 
The situation is even worse in schools with large concentrations of low-income students. Despite some closing of the 
achievement gap in some subjects and grades, the achievement of students from high-poverty schools remains too 
low, and still falls well short of national and state goals. We must raise expectations for all children, doing every- 
thing we can to ensure that no child falls behind. While the Title I program cannot close the achievement gap by 
itself, it can serve as a powerful lever for change in partnership with districts and states that are committed to rais- 
ing the achievement of low-income students. If state and local reform efforts are weak, we cannot expect to see the 
gap close; but if state and local efforts are more ambitious, then the funding Title I provides can facilitate these 
efforts, and we can reasonably expect more ambitious results. 
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II* How the federal role was reshaped in 1994 



The main focus of this report, like the Department's reports, is on the operations and effects of the programs amend- 
ed or newly authorized in 1994. That year was on important one in the history of postwar federal aid to elemen- 
tary and secondary education, for it sow a shift toward different ideas about educational improvement and ways the 
federal government could best support states and school districts. We describe those ideas here. 

The 1994 lows built on the momentum of a reform movement that hod been gathering strength in the states and 
school districts over the previous decade. During the 1980s, the publication of the groundbreaking report 4 Nation 
at Risk and on "education summit" — ot which President Bush and the nation's governors forged common ground 
around a set of notional education goals — ^touched off a new wove of school reform focused on higher standards, 
0 movement with octiyity at the local, state, and federal levels. Many states enacted legislation containing ambi- 
tious statements abput.whot they expected students to know and be able to do. They also began to put account- 
ability systems in place to shine a spotlight on failing schools and, eventually, to impose sanctions on those schools. 
President Bush's America 2000 program supported states' and districts' early work on standards and accountability. 
This work continued in the Clinton administration under the auspices of the Goals 2000 initiative. 



At the some time that policymakers wanted to support the reform initiatives taking shape across the country, they 
also wanted to move away from old ideas about the federal role that might be hindering some children's full 
participation in school improvement. A central concern in the 1994 reouthorizotion of the Elementary and 
Secondary Education Act was that the very presence of separate, categorical programs could contribute to diminished 
expectations for the children participating in these programs — especially for low-income children! Thus, during the 
1994 reauthorization, new legislative language emphasized state and local policies that would raise standards and 
improve instruction for all students but especially for those students targeted by federal aid programs. States and 
districts would be held accountable for results but in return would receive greater flexibility. These changes 
represented a complete overhaul of the structure and requirements of the Title I program. The program's purpose, as 
stated in the law, was now "to enable schools to provide opportunities for children served to acquire the knowledge 
and skills contained in the challenging state content standards and to meet the challenging state performance 
standards developed for all children." 

This new policy framework was referenced in most programs, but articulated most strongly in the Title I program. For 
the first time, the Title I law now explicitly states that disadvantaged children should be held to the same standards ds 
other children, and it ties accountability to these results, asking states to create consequences for schools that fail to raise 
the academic performance of children participating in the Title I program. These amendments significantly raised the 
stakes for Title I, which was originally designed in 1 965 to help schools meet the needs of disadvantaged children 
by providing additional funding to districts with large numbers of children from poor families. 
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Beginning in the 1970s and continuing into the 1980s, policymakers hod focused more attention on whether the test 
scores of children participating in Title I were increasing. Conflicting evidence emerged on this point. Under the Title I 
Evaluation and Reporting System launched in the mid-1970s, states did report gains by participating students. 
However, federally funded studies of Title I and Chapter 1, including Sustaining Effects in the 1970s and Prospects 
in the 1990s, showed little or no progress in closing the achievement gap through the early to mid-1990s. To be 
sure, these studies could not measure how the participating children would have performed had they not received 
Title I or Chapter 1 services in the first place. It is certainly possible that the achievement gap might hove widened 
further in the absence of the services and resources provided by the program. Nevertheless, the studies did raise 
important questions about whether participating children had benefited enough from the program. These questions 
linger, although in fact the conclusions of those studies do not apply to the current version of Title I, which is sub- 
stantially different from the earlier legislation. 

Thus, Title I needed to be redirected in 1994 to be more effective in improving the achievement of poor children. 
Having observed that a promising movement for school improvement was gathering steam in the states, and con- 
tinuing to identify shortcomings in the existing federal programs, Congress enacted and President Clinton signed leg- 
islation designed to bring federally supported services under the umbrella of challenging state standards for content 
and student performance. This approach would ensure high expectations for all students, including those living in 
poverty, and federal aid would support the work of states and districts in upgrading instruction to meet the stan- 
dards. The legislation recognized that states and districts would need time to align their policies in support of stu- 
dent achievement (see Rgure 1 ). 



Now, however, is a reasonable time to begin looking at their progress. 



Timeline for Title I Accountability 



1995 1996 1997 1998 1999 2000 2001 






1 identify schools and districts in need of Improvement, using I 

1 accurate infohnation about academic progress | 




Adequate Yearly Progress 
definition to result in continuous 
and substantial yearly 
improvement of each district 
and school sufficient to achieve 
the goal of ail children meeting 
the proficient and advanced 
levels of performance 



Figure I . U.S. Department of Education, Promising Results, Continuing Challenges: The Final Report of the 
National Assessment of Title I (Washington, DC: U.S. Department of Education, 1 999). 
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III. How is the 1 994 legislation being implemented, 
and what remains to be done? 



As we have seen, the 1994 legislation placed large and complicated challenges before the nation's schools and the 
governments that support them. The Department of Education has reported the progress made.in overcoming these 
challenges and the areas in which it believes more work needs to be. done. We offer here our own comments on the 
progress so far observed in implementation and on the important work of policy and practice that still lies ahead. 

if schools are going to bring all students to the level of performance that tomorrow's world will demand, then schools, 
school districts, states, the federal government, and the education profession will all have to make progress in six 
mutually reinforcing domains: 

1. Resources must be targeted appropriately, and equity for special student populations must be at the forefront of 
policy concern. 

2. Standards must provide the scaffolding for a challenging curriculum that is accessible to all students. 

3. Assessments and accountability must push the education system toward improvement while support and technical 
assistance build the system's capacity to improve. 

4. The teachers and other adults who work with students must possess high levels of skills and knowledge. 

5. Schools, school districts, and states must develop, implement, and maintain comprehensive programs of school, 
family, and community partnerships to get parents involved in children's education in ways that promote student 
success. 
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6. Well-supported research and evaluation must inform policy and practice. 

None of this is easy to accomplish; nevertheless, all of it is consistent with the framework and expectations of current 
federal low. 
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We endorse the continued pursuit of the framework for educational improvement set forth in the 1994 legislation, 
with some revisions to reflect what has been learned in the post five years of implementation. Drawing on the 
Department's reports and our own professional experience, our more specific comments and recommendations 
follow. 






Equity and Adequacy in Resource Allocation 

A central principle of the federal role in education is its focus on students in high-poverty schools and other students 
with distinctive needs. We strongly endorse this focus, and we want to highlight it in our comments and recommen- 
dations. 

The Department's reports to Congress show that Title I funds continue to be targeted on schools with high proportions 
of students living in poverty, and that the 1 994 amendments have, if anything, strengthened this targeting. Because 
we are troubled by the inequity in overall educational resources available to students living in different economic 
circumstances, as described in an earlier section of this report, we believe that this targeting of federal dollars is 
crucial. 



O 

ERIC 



I8i 



er|c 



The 1994 amendments required that districts serve all high-poverty schools (at least 75 percent poverty student popu- 
lations) before serving other schools. The increase in funding going to high-poverty schools can be attributed to this new 
requirement and also to the increased appropriations for concentration grants under Title I. The low also required a shift 
from county to district allocations in order to update poverty counts and improve targeting to districts. However, the 
impact of this change has been mitigated by a "hold harmless" placed on grants for fiscal year 1 999 — o congressional 
policy that contradicts the earlier change in the low, and one with which we disagree. Rnally, we commend the increase 
in concentrotipn grants and recommend appropriating more funds through these grants. 

We also recommend increasing the funds appropriated for the Title I program as an effective means of targeting 
more aid to disadvantaged students. Although Title I appropriations hove increased in recent years, they represent 

0 shrinking proportion of federal funding for elementary and secondary education. In 1994, Title I received 
$7 billion o year while other elementary and secondary programs received $6 billion; Title I currently receives 
$8 billion annually while other elementary and secondary programs receive $1 1 billion. This means that Title I is 
now getting o smaller shore of federal funds than it did five years ago. In addition. Title I is not fully funded. 
According to estimates provided by the Congressional Research Service, funding Title I Port A Basic Grants to the 
maximum amount authorized would require o $24.3 billion appropriation. Currently, Title I is only one-third 
funded, at $8 billion o year.’’ We recommend that Title I be fully funded. 

A 1 998 study by the U.S. General Accounting Office (GAO) found that federal dollars hove been more effectively 
targeted on poor students than state and local dollars. The GAO study found that federal funds provide on overage 
of on additional $4.73 per poor student for every $1 in federal K-12 education funding, while state funds provided 
only on additional $0.62. Another study found that the poorest districts actually receive less state and local funds 
than the wealthiest districts. Districts in the highest-poverty quortile, which educate 25 percent of the nation's stu- 
dents and 49 percent of its poor children, receive 43 percent of federal funds and 49 percent of Title I funds but 
only 23 percent of state and local funds. But districts in the wealthiest quortile, which also educate 25 percent of 
the nation's students but only 7 percent of its poor children, receive 1 1 percent of federal funds, 7 percent of Title 

1 funds, and 30 percent of state and local funds. ” 

Thus, Title I is on effective means of providing extra financial resources to address the problems of disadvantaged 
children, more targeted to that purpose than most state and local aid. Yet, Title I is shrinking in its shore of feder- 
al financial resources for education. Notional attention has turned elsewhere, while the problems of the most 
disadvantaged in our society hove not gone away. As noted elsewhere in our report, one-fifth of American children 
are from poor families; and the groups with the highest concentration of poverty are generally the ones experiencing the 
most growth in the population. For that reason alone, we must intensify our attention to meeting their needs. If 
Title I were funded fully, the hundreds of thousands of students in need who are not served now could be served. 
School districts could improve the intensity of their efforts, professional development could be improved, and more 
funding could be available for parental involvement. 

We caution that Title I funds — currently amounting to an average school allocation of $61 3 per low-income student 
per year even in the highest-poverty schools — cannot fully close the spending gap between districts. Annual dis- 
trict spending ranges from $3,343 to $1 2,475 per pupil in this country.” We would therefore not want policymak- 
ers or the public to give Title I oil the credit or blame for the trends in poor children's achievement. States and local- 
ities, which pay for more than 90 percent of the cost of elementary and secondary education, must be mainly 
responsible for closing the gap. 
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Equity issues arise not only in connection with family poverty but also with regard to children's linguistic and cul- 
tural backgrounds. The burgeoning population of English-language learners poses important policy challenges. 
These children ore now participating more fully and equitably in Title I services, thanks to a policy change in the 
1994 amendments that removed previous restrictions on services to children with limited English proficiency. 
According to the Department's Title I report, the program now serves 2 million students with limited English pro- 
ficiency. We wish we could comment on evaluation findings about the services they ore now receiving under 
Title I — or, for that matter, under the Bilingual Education Act — but unfortunately such evaluation, which is 
funded by the.Office of Biljnguol Education and Minority Languages Affairs, has not been fully integrated into 
the National Assessment of Title I and other reporting of the Planning and Evaluation Service. By contrast, the 
National Assessment has done a good job of assessing services to migrant students and is to be commended for 
integrating this analysis into its oyerqll reporting. 

We note, too, that the federal responsibility for Indian students has not been well met. Research information about 
these students is lacking, and programs have not consistently addressed these students' serious needs. 

Still another aspect of equity is the participation of students attending private schools, including religious schools. We 
continue to endorse the principles that guide their participation in Title I: providing direct benefits to the child, and 
requiring public trusteeship of the dollars. Recent data show a decline in the number of private school students 
served. We recommend that public school officials fulfill their legal responsibilities to identify eligible private 
school children. They also rhust consult with private school officials about how those children will be served. 
Reversing an earlier decision, the Supreme Court's ruling in Agostini v. Felton in 1997 now permits service delivery 
in religious schools under specified conditions. However, some private schools still lack the space to provide these 
services, and as a result, local Title I programs face such costs as the rental or purchase of trailers or transportation 
to alternative sites. We support the coiitinued availability of special, set-aside Title I funds to defray these costs, cur- 
rently known as “capital expenses." 

Thus, equity and adequacy in resources have many dimensions. We are particularly concerned with the federal role 
in improving education for children who live in poverty, but we also urge continued attention to all the populations 
of students for whom existing educational conditions fall short of what they need and deserve. 



High Academic Standards for All Children 

The initiation of a movement calling for clear and high standards in America's classrooms has been a significant mile- 
stone, and the mandatory inclusion of the nation's most disadvantaged students in that movement has been anoth- 
er. For the first time] federal law now stipulates that all children, including those served by Title I, must be held to 
the same challenging standards, although leaving states the freedom to define those standards. Already some sig- 
nificant progress has been made. With federal support and encouragement, substantial and Increasing numbers of 
states and districts are defining and adopting standards, and beginning to insist that they apply to all students. 
Almost every state has adopted content standards. Some big-city school systems have made a vigorous commitment 
to raising standards and improving student achievement. 
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The standards mavement is nat withaut its challenges, hawever. Althaugh the states have generally succeeded in 
develaping cantent standards, the quality af these standards is uneven. In recent years, several independent analy- 
ses of state content standards have been conducted by such diverse groups as the Fordham Foundation, the American 
Federation of Teachers, and the Council for Basic Education. Their ratings differ considerably — a state's standards 
might earn an A from one group and a C from another, and they use different criteria to judge the standards, but 
the one thing they do agree on is that state standards are of varying quality and varying levels of specificity. 

One reason for the divergent conclusions b the lack of a clear consensus on what constitutes good standards. 
Differences exbt as to how specific or general standards should be and how often they need updating. Serious db- 
agreements also exist over what content should be included and what should be omitted. There is, however, some 
research that addresses at least a part of what good content standards should be. They should have the force of law 
behind them and be explicit in describing the desired content, based on prevailing norms and expertise, and assess- 
able. As the field of standards development matures, more consensus around qualities such as these may emerge. 
What is clearly needed — and is developing in the states — is the capacity to formulate, review, and refine standards. 
States are still struggling with the questions of what constitutes good standards and how to align them with assess- 
menb, and they need more high-quality technical assistance and other resources in these endeavors. 

Another important area of need is the translation of standards into curricular frameworks that are sufficiently 
detailed and complete to guide teaching practice. Thb b an area in which capacity appears to be falling short of 
what b needed. States, dbtricts, and professional organizations must bring more resources to bear on curricular 
development and classroom implementation. 

Different institutions have different roles to play in the standards movement. By law, the U.S. Department of 
Education can only approve the process by which states have developed their standards, not the standards them- 
selves. Reflecting thb legal constraint, the Department's reports to the Congress merely report how many states 
have standards and studiously avoid comment on the quality of those standards. The external organizations that 
have begun to evaluate and rate standards are under no such constraint, however, and we welcome their participa- 
tion in the movement. Their work should continue to support that of the states, which continue to play the central 
role. We encourage the states to continue developing their capacity to articulate challenging standards, and we 
agree that the federal government should stay out of the business of evaluating the quality of standards. 
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Assessment, Accountability, and Support for Improvement 

After the initial development of standards, states and school districts must address the whole domain of assessment 
and accountability — measuring achievement of standards; setting high but attainable performance expectations for 
students and schools; communicating with teachers, parents, and students about standards; and holding schools 
accountable for results. These tasks ore difficult ones, and states need technical assistance in carrying them out. 
They hove also needed flexibility in their timelines. Although the 1 994 low called on states to set performance stan- 
dards for students and then develop assessments aligned with them, many states hove actually preferred to begin 
with the assessments and then define performance standards in relation to the new assessments. The Department 
of Education has shown the proper flexibility in allowing states to follow this different sequence; we cite this os a 
good example of the way many agencies hove hod to learn from experience in the new terrain of educational 
reform. 

Increased attention has been placed at all levels of government on holding schools and districts accountable for 
results. This climate of heightened interest in accountability has prompted policymakers to grapple more intensely 
with how to help failing schools transform themselves into high-performing organizations — and what to do if, 
despite extensive intervention, they continue to stagnate. We wont to emphasize that accountability con only be con- 
sidered a success when it applies equally to oil districts, schools, and students, including the Title I population that 
has been neglected too often in the post. We also observe that accountability must emerge from o public dialogue 
in which our communities hove o chance to articulate clear expectations for the educational system. 

Current low requires that every school and district receiving Title I funds demonstrate that it has mode "adequate 
yearly progress" toward the goal of enabling students to meet challenging state performance standards. If the state 
has its own accountability system, it must apply the some requirements to Title I and non-Title I schools. Thus the 
low asks for movement toward the some set of standards and the some challenging curriculum for oil children in o 
state, and it mandates the some accountability structure for oil schools. 

We believe that poor students should hove access to rich instruction in oil subjects, not just what is needed to meet 
minimum expectations in reading and mathematics. As states develop standards and align assessments in other 
subjects besides reading and mathematics, we expect them to hold both Title I and non-Title I students to the some 
challenging standards. However, we believe that the timing and implementation of this broadening of accountabil- 
ity into other subject areas should be left up to states and districts. 

We also believe that it is inappropriate to use only the bell curve of norm-referenced test scores to measure and 
report student progress. States should be using tests that ore instructionolly sensitive and geared to their own clear- 
ly defined standards of performance. 

Moreover, despite the low's intention of bringing Title I students under the some framework of school and district 
accountability that enforces high expectations for oil students, the Department's reports show that states con and do 
construct two different accountability systems. Although o recent study of state implementation of federal programs 
found 23 states reporting that they hove the some accountability system for the state os for Title I, other states hove 
different accountability procedures, and that leads to confusion. One study of local and state accountability systems 
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in three states and twa cities faund that same Title I schaals were identified as in need af impravement hy the state 
hut net hy the Title I system, and same were identified hy Title I hut net hy the state. Anather study in 1 2 districts 
faund twa systems at wark in mast af them. As the Department's Natianal Assessment af Title I nates, "There is same 
tensian between the twa, and same canfusian aver implementatian af the Title I requirements." 

Ta address this prahlem, we return ta the idea that federal lows are intended ta suppart state impravement effarts. 
Because the state's awn system af accauntahility cammands sa much attentian fram schaals and districts, we encaur- 
age Title I palicy ta reinfarce the state system while strengthening it if passible. Because children are ill served by 
separate systems af accauntahility. Title I pravisians shauld push states ta bald all schaals — nat just Title I schaals — 
accauntable, either thraugh their awn accauntahility system ar the Title I system, whichever sets the bar higher. We 
alsa think states shauld be encauraged ta seek external peer review and validatian af their assessments, praficien- 
cy levels, and accauntahility indices, and ta encaurage a braad public dialague within the state abaut standards and 
assessments. The bases far the canstructian af an accauntahility index and the cut scares used ta establish different 
praficiency levels shauld be made public. 

Suppart far cantinuaus impravement remains vitally impartant, and the Department's evidence suggests that the 
need far high-quality technical assistance cansiderably autstrips the supply. States shauld take respansibility far 
building their districts' and schaals' capacity ta meet the demands af accauntahility systems. The budget far feder- 
ally supparted technical assistance shauld increase. A variety af mechanisms far delivering assistance can fill the 
varying needs af different states and lacalities; the key paint here is that accauntahility by itself will net cause schaals 
ta imprave, because prafessianal knawledge and skill are just as impartant as mativatian. 

Rnally, we turn ta the subject af the accauntahility af federal agencies and state and lacal schaal systems far results. 
This reautharizatian af ESEA pases difficult trade-affs between seeking greater accauntahility af federal agencies far 
pragram autcames under the Gavernment Perfarmance and Results Act (GPRA) while simultaneausly expanding the 
Ed-Flex legislatian ta give states mast aperatianal decisian-making far thase pragrams. The central questian, it 
seems ta us, is. Haw can the Department af Educatian be accauntable ta Cangress far results if it dees net have deci- 
sianmaking and aversight respansibility far haw pragrams are implemented at the state and lacal levels? 

State and lacal educatian agencies already have varying degrees af latitude abaut haw they carry aut natianal abjec- 
tives in their awn refarm plans. The Safe and Drug-Free Schaals and Cammunities Act (Title IV) and Innavative 
Educatian Program Strategies (Title VI) give them the most flexibility. The revisions to Title I in 1 994 enhanced state 
and local flexibility by authorizing greater use of schoolwide programs, by loosening eligibility in targeted assistance 
schools, by granting waivers, and by permitting consolidation of administrative funds. 

Flexibility in and of itself will not produce better results, especially when the authority to make decisions resides at 
the state and local levels, while a federal agency is held accountable. However, flexibility con work if it ultimately 
is linked to the accountability of state and local school systems for results. 
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Quality of Instructional Staff 

State and local education agencies enjoy a great deal of discretion in decisions about the educational services that 
they support with federal funds, consistent with this nation's decentralized system of educational governance. 
However, one issue in the quality of educational services deserves special policy attention from oil levels, including 
the federal government: the skills of instructional staff in the notion's schools in general and in high-poverty schools 
in particular. 

We believe that children in high-poverty schools deserve the best-trained, best-paid teachers we con provide. 
Instead, many of these children ore being taught by untrained aides without a college diploma, something that would 
be intolerable in more advantaged school systems. Research documents the effect over time of teachers' prepara- 
tion on student achievement. Simply put, students who hove more highly trained teachers perform better. 
Furthermore, the less additional support and enrichment students receive outside of the classroom, the greater effect 
their teacher's background has on their achievement. 

The concentration of less well trained teachers in high-poverty schools is o major contributor to low student achieve: 
ment in these schools. We recommend requiring states and districts to ensure that the qualifications of teachers and 
aides in high:poverty Title I schools (including type of license/certificate and placement in mojor/minor fields) be os 
good os those of the best teachers in their states. 

The definition of teacher quality should take into account more than just subject matter and pedogogicol knowledge. 
Knowing one's students, including their language and cultural background, and being able to address o variety of 
needs represent o higher standard for teacher quality. Professional support needs to accompany accountability. 
Greater investment is necessary in high-quality professional development for teachers that is aligned with the new 
state and local standards. This investment should be larger — and the strategies should be more effective — ^thon 
most states and districts have been willing to provide in the post. 

Secretary of Education Richard Riley said in his State of Education address on February 16, 1999, that "no child 
should be taught by on unqualified teacher." Yet thousands of educationally disadvantaged students ore being 
taught by Title l-poid aides who hove only a high school diploma. According to the Follow-Up School Survey for the 
1 997-98 school year. Title I employed 76,893 aides and 74,664 teachers. The schoolwide programs in higher-pover- 
ty schools used more aides (43,880) than teachers (40,880), while targeted assistance schools employed slightly 
fewer aides (33,013) than teachers (33,784). Overall, only 25 percent of Title I aides hove earned a bachelor's 
degree, while nearly all (98 percent) hove completed high school. The ratio of aides to teachers in Title I in the 1 997- 
98 school year is approximately the some os it was in Chapter 1 schools in the 1 990-91 school year. 

Promising Results, Continuing Chollenges: Jhe Finol Report of the Nationol Assessment of Me I notes that paraprofes- 
sionols, or classroom aides, ore often assigned responsibilities that ore more appropriate for teachers, and about two- 
thirds of paraprofessionals reported that they had received less than two days of training since the end of the previous 
school year. Many paraprofessionals lack the necessary education background to perform the teaching duties that they 
are assigned when schools are short-staffed. 





while Title I can provide supplemental funding to states and districts, it cannot control whether they assign high- 
quality staff to high-poverty schools, except in the case of those staff members supported by federal funds. It also can 
support high-quality professional development for the teachers and paraprofessionals in the high-poverty schook thot it 
funds, in accordance with the best available knowledge about what works in professional development. 

We must improve all phases of teachers' career development, from teacher preservice education to teacher recruit- 
ment and professional development, so that teachers in high-poverty Title I schools are as good os any others in their 
state. Indeed, as we enter a new millennium, all teachers must be prepared to instruct students in challenging sub- 
ject matter in on environment characterized by high standards. They will need excellent, ongoing professional devel- 
opment so that they can continually refine and sharpen their skills. Should the Congress fully fund Title I, os we 
recommend, we believe this arena — recruiting, training, and supporting good teachers in the nation's highest-poverty 
schools — ^would be the best use for new federal dollars. At the same time, the Congress should not spend federal 
funds on the use of paraprofessionals for instruction because they generally lack high-quality training for that role, 
and should begin to phase out the use of paraprofessionals in instruction altogether during the next reauthorization. 
The only exception to this should be using aides to assist instruction where many of the students are from non- 
English-language or minority cultural backgrounds. 

School, Family, and Community Partnerships 

Extensive research and exemplary practice have shown what constitutes a comprehensive program of school, fami- 
ly, and community partnerships. This is ocknowledged in the National Assessment of Title I. We agree with the 
Department's recommendations for needed improvements in partnership efforts, including the goal for districts to 
coordinate and integrate the many family and community involvement initiotives in various federal, state, and local 
programs, and to improve the way programs are evaluated. But we would go further; We urge the Department to 
encourage and enable states, districts, and schools to fulfill the intent of the law to establish and maintain compre- 
hensive programs of school, family, and community partnerships. 

One major emphasis of the 1994 Title I legislation is for schools to get all families involved in their children's edu- 
cation, and to mobilize family and community support and resources for students and for schools. The legislation 
requires every school receiving Title I funds to strive to create one school community that includes all families, and 
get families involved in helping students succeed in school. These emphases were designed to correct earlier prac- 
tices thot separated parents of children receiving Chapter 1 Aitle I services from other parents in the school, and to 
challenge schools to select family involvement activities that would specifically contribute to students' academic suc- 
cess. We strongly endorse the intent of the 1994 legislation, but more must be done to build state, district, and 
school capacity to implement purposeful and comprehensive partnership programs. 

Although some schools have made progress in the intended directions, most elementary, middle, and high schools 
receiving Title I funds have not received adequate guidance in how to develop ongoing programs of school, family, 
and community partnerships. Part of the problem has been an overemphasis on the term "school-parent compact," 
which is interpreted in some places as a broad policy and plan, but in most places is merely a mechanical pledge or 
agreement signed by parents promising their involvement. Once signed, it is often filed away and forgotten. 
Because of a lack of consistency in definitions for the term "compact," data collected on compacts are not inter- 
pretable, and do not accurately or adequately indicate either the progress mode by Title I schools in meeting the 
mandate for productive partnership programs or the problems they face in doing so. 
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The Departmenfs report points out the importance of six major types of involvement ” linked to school improve- 
ment goals for student learning, and a few activities that such programs should take. It will, however, take more 
than a piecemeal approach of adding this activity or that for Title I schools to get parents and the community involved 
effectively and equitably in productive ways. It will require building the capacity of leaders in states, districts, and 
schools to understand, plan, implement, and evaluate programs of partnership at all policy levels.^ 

This requires states and districts to organize offices with adequate staff and more realistic budgets for appropriate 
training, dissemination, program development, and evaluation activities, and with a philosophy of facilitating and 
supporting all schools in developing their site-based programs of school, family, and community partnerships. The 
current set-aside of 1 percent of Title I budgets in districts receiving $500,000 or more in Title I funding is not ade- 
quate for supporting district-level and school-level staff and program costs that are needed in full partnership pro- 
grams. We recommend that states, districts, and schools set realistic budgets for developing and maintaining these 
programs. 

Data are needed on the effective implementation and results of planned programs and specific activities that get 
families involved in their children's education. 

In comprehensive programs of partnerships, teachers, administrators, parents, community members, and special 
staff, including Title I aides, special education leaders, and others associated with family involvement (nurses, librar- 
ians, school secretaries) work together as a team to plan and implement goal-oriented involvement activities every 
year. It is imperative to take a team approach. Teachers are important members of this team in order to persuade 
families to participate in such activities as understanding report cards and improving grades, monitoring homework, 
and working with teachers in parent-teacher-student conferences and other learning-related activities. Because 
teachers are key participants in programs of partnership, we do not favor recommendations that suggest parental 
involvement be the responsibility of Title I aides. Such an approach establishes inadequate leadership and lacks the 
shared investments needed to organize, implement, evaluate, and maintain a program of partnerships. When edu- 
cators, parents, and others plan and work together on all types of partnership activities, schools have fuller and 
stronger programs that come closer to realizing the 1994 Title I legislative intent. 

Research and Evaluation 

This report, like the Department's reports, is based on incomplete knowledge. Because the full implementation of 
the 1994 laws has yet to occur, it is too early to expect much direct evidence about the impact of these federal pro- 
grams on students' educational success. Initial clues (and they are only clues) can be found in the recent NAEP data 
and in those states and districts that moved most rapidly to implement the reforms for Title I required in lASA. That 
evidence is provided in the Department's reports. The picture is one of modest early success in raising achievement 
and narrowing the gap in test scores associated with student poverty, but the evidence is not yet compelling. These 
early trends and indicators will have to be monitored carefully over time, and more evidence must be gathered from 
sites that have moved more slowly in response to federal policy. Moreover, the federal government provides about 
7 percent of funding for elementary and secondary education, and this small financial contribution must work in the 
context of broader societal, professional, and policy trends. 
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Thus, both because implementation of the lows under our purview is occurring slowly and because the lows them- 
selves cannot be the dominant influence on achievement, current national data should not necessarily be taken as 
evidence of the impact of federal lows. Instead, more time should be given for implementation, and more tightly 
focused evaluation and research must provide the basis for conclusions about impact. 

We also note that if the Congress had appropriated larger sums for evaluation, we would know more about the 
results of the programs. It is difficult enough to conduct longitudinal studies within a five-year period of a program 
that is still being implemented; moreover, the entire National Assessment of Title I was significantly delayed by fund- 
ing problems. We find it unacceptable that as a nation we spend hundreds of billions of dollars on education, but 
do not fund the research and evaluation necessary to assess the effects of that investment. Title I illustrates this 
problem. The nation spends several billion dollars each year on the Title I program, but since reauthorization the 
budget for evaluation has averaged only $5 million a year. 

During the next reauthorization, we recommend a set-aside of 0.5 percent of program funds, half of which should 
be allotted for evaluation and the other half for research and development. In evaluation, we believe it will be 
imperative for the Department of Education to support studies that assess more definitively the achievement of stu- 
dents participating in Title I. Although we recognize the difficulties of identifying suitable comparison groups, we 
think that more sophisticated research and evaluation strategies can better capture the effects of Title I than the tech- 
niques we have used to date. We also urge that more participating students and schools be followed over time; such 
longitudinal designs can offer the best evidence of program effects. The current Longitudinal Evaluation of School 
Change and Performance has provided some analyses of its first two years of data in the final report of the National 
Assessment. We commend the Department for moving quickly in the analysis and release of these early data, but 
we caution that more data, analyzed with more time for thoughtful scrutiny, will be needed before this study offers 
clear answers. 

With regard to evaluation, we would also like to see some studies designed specifically to generate findings as rapid- 
ly as possible for practical application. Too often, evaluation focuses exclusively on arriving at summative judgments 
about overall program success or failure, neglecting its formative role in the effective investment of funds and 
improvement of services. 

Paired with the set-aside for evaluation, an equal sum for research and development is needed to identify effective 
practices in the field, to build on theory, and to refine model programs for wider implementation. The demand for 
"best practices" is increasing, and the knowledge base needs to keep pace. A significant investment in research and 
development is the best foundation for the dramotic improvements in education that all the nation's children need 
and deserve. 
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IV. Conclusion 



We commend the Department on its evaluation work in the two reports, Promising Results, Continuing Chollenges: 
Jhe Finol Report of the National Assessment of Title ( and Federal Education Legislation Eriacted in 1994: An 
Evaluation of Implementation and Impact. In reflecting on the findings in these reports, we believe that the feder- 
al government must reaffirm its dual commitment to equity and excellence in any new elementary and secondary 
education legislation that it enacts. Given the existing achievement gap and the difficult conditions in which many 
poor children live, it will not be easy to ensure that all children can meet the challenging standards being established 
by states and districts. Continued federal support for schools with many children from low-income families will be 
essential for all children to learn at high levels. While this aid cannot close the achievement gap by itself, it can 
enhance and catalyze improvements in those districts and states that have made a vigorous commitment to raise the 
achievement of low-income students. We support the provisions of the 1994 laws. Although we still lack the data 
we need to judge the full impact of the significant policy shifts of 1994, we believe the framework set forth in the 
1994 legislation is a good starting point. This report of the Independent Review Panel offers recommendations for 
changes needed, based on what has been learned over the past five years, in order to ensure that measurable 
progress will be made in the next authorization period. 
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